414 


IRE TRANSACTIONS ON ELECTRONIC COMPVTeMs 


June 


?>• to state Qi with exactly tn steps (i.e., with 
m inputs) and 0 otherwise. Also, the i—j en- 
ir> of B m is 1 if it is possible to proceed from 
state q> to state q, with at most m inputs, 
and 0 otherwise. 

We wish to show that for some m every 
entry in the first row of B m is a l, i.e., b 0 j (m) - 1 ; 
0<j<a — 1. Thus, with a suitable input se- 
quence of at most m bits, you can go from 
State go (the initial state) to every other 
state. 

Upon computing the matrix A p „ we find 
that for 0<k<ma — 1 


a, 7 (>") = 1 w hen 


f i — k (mod a) 

ka 


and 


= 0 otherwise, 
fig. 5 shows A z and A z for a = 6. 
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Fig. 5— Transition matrices for a=f>. (a) At. (b> At. 


Observe that the number of l’s in each 
column of A m is 2" for 2 m <a. and that for 
2 m >a the matrices A m and B m have all their 
entries equal to 1. Hence the number of in- 
put bits required to go from any state to 
any other state is no larger than the least 
integer greater than or equal to log* a. Thus, 
starting in state g 0 , each of the a states can 
be reached. This shows that a states are 
both necessary and sufficient for a Turing 
machine of our form to perform multiplica- 
tion by a. 

Joel M. Winett 
M.I.T. Lincoln Lab. 

Lexington, Mass. 


Improved Memory Matrices 
for the n-Tuple Pattern 
Recognition Method* 

Summary 

It is shown that a previous version of 
the w- tuple pattern recognition method can 
be made more effective by making certain 
changes in the learning phase. A means of 
further increasing readability through judi- 
cious choice of ra-tuples is described. 

Introduction 

Two phases, “learning," and “reading” 
are used in the n - tuple pattern recognition 
method. 1 The memory matrix stores infor- 
mation obtained from sample patterns dur- 

* Received July 2, 1961. 

1 W. W. Bledsoe and I. Browning, “Pattern recog- 
nition and reading by machine.” Proc. Eastern Joint 
Computer Conf„ Boston. Mass., pp. 225-232; 1959. 


ing the learning phase, and this stored infor- 
mation is used in the reading phase to iden- 
tify patterns not previously presented. Ob- 
viously, the quality of information stored 
and the methods’ success are directly re- 
lated, although other factors must also be 
taken into account. 

A storage address for each possible state 
(0, 1,2, • • ■ , 2 n — l)of each K-tuple for each 
character type ( e.g ., A, B, C, • • • ) is pro- 
vided in the memory matrix. Only O’s-and l’s 
were stored in these addresses in the original 
version. 8 A 1 was stored in a given address if 
the re-tuple in question was placed in the 
specified state by any one of the given char- 
acter images presented during learning. 
Even in this original paper it was suggested 
that the, memory matrix might be used 
more effectively if frequencies, rather than 
merely 0's and l’s were stored. 3 This sugges- 
tion, however, was not exploited at that 
time. This paper seeks to demonstrate that 
readability with the re-tuple method is much 
improved if memory matrices are chosen 
which are more nearly optimum than are 0, 

1 matrices. Variations resulting from value 
changes of the parameter n are also given. 


The Frequency Memory Matrix 
A different learning mode lor the mem- 
ory matrix is given in each row of the first 
column of Table I. The original re-tuple pro* . 
cedure with its 0, 1 matrix is represented in 
row 1. " 

Row 2 represents a memory matrix ob- 
tained by adding l’s to the appropriate ad-,./ 
dresses during learning, and then dividing 
final sums by the number of sets learned 
(40 in all cases reported hefe). This fre- 
quency memory matrix was used as a first 
step in obtaining the matrices represented 
in rows 3, 4, 5 and 6 of Table I. 

Three Normalizations of Frequency 
Memory Matrix 

Three normalizations of the frequency 
memory matrix are given in rows 3, 4 and 5 
of Table I. For row 3, the matrix was nor- 
malized “within state,” that is, each entry v. 
was divided by the sum of all entries re- 
ferring to the same state of the same re- 
tuple. 

Highleyman’s and KamentskyV nor- 
malization procedure* was used to obtain ; 
the results shown in row 4, Table I. They 


TABLE I 

Per Cent Recognized Correctly 
Comparison op Methods 


Row 

, Method 

40 Seta Read 
(Same a3 learned) 
«=1 2 6 

10 Seta Read . 
(Different than learned) 'SK 

2 ■ ■ «• , ‘-M 

1 

2 

3 ! 

4 

5 

6 

0 , t Matrix 
Probability Matrix 
Normalized Within State 
Highleyman-Kamcntsky Method 
Highieyman-Kamentaky Method, 
Zero State Suppressed 
Maximum Likelihood Method 

% % % 

13.0 62.0 

45.0 48.5 

70.0 70.0 

77.5 78.5 81.5 

76.7 77.2 80.7 >, 

79.7 83.2 91.7 

% % % Tfjjfl 

* j m 

47 47 -• ■, « 

58 58 S3 ‘ 

59 62 5*^11 

6i 6i : 


Source of Data 

The images used to obtain data given in 
Table I consisted of 50 sets of handwritten 
numbers, 0 through 9, for a total of 500 
separate images. These numerals were 
written by 50 different persons at Bell 
Telephone Laboratories. 4 Subsequently, the 
images were individually digitized on a 12 X 
12 grid. In all trials reported here, 40 sets 
were learned; following which, all 50 sets 
were read. Before learning or reading, each 
image was centered by placing its center of 
gravity at a predetermined point on the 
“retina.” 


used the method quite successfully, ost this’; 
same date, for the case of »->{.* As nS/fy 
ported in row 4, the matrix entrie* were 
normalized “within character claasi? 
entry was divided by the square root at the., 
sum of the squares of entries referring to Ifee s 
particular character class. The ntetifc fc 
thus reduced to a set of unit vectors. 

A variation of the Highleyman-Kameat* 
sky normalization technique, in which the 
zero states of the re-tuples are suppressed, 
is represented in row 5 of Table I. This 
corresponds, in the case of re = 1, to handling 
“black” image areas only. 


rm 




Percentage of characters successfully 
recognized under a variety of conditions is 
summarized in Table I. The various methods 
used were listed in the first column. The 
second column shows percentage success- 
fully read via each method, using the 40 
alphabets already learned. The third column 
shows percentage successfully read of the 10 
alphabets not previously learned. (Ties in 
all cases are counted as failures.) In each 
case, results are shown for « = 1 , « = 2, and 
« = 6. j 

1 Bledsoe and Browning, ibid . , pp. 225-227. 

* Bledsoe and Browning, op. cit., see “Probability," 
p. 231. 

* Provided to the authors by W. H. Highleymaa 
and referred to by Highleyman and L. A. Kamentsky 

5' omnlents on a character recognition method of 
Bledsoe and Browning,” IRE Trans, on Electronic 
Computers ( Correspondence ), vol. EC-9, p. 263; June. 


The Maximum Likelihood Technique t 

A procedure 7 based on a maximum like- 
lihood technique was employed to obtain % 
the results given in row 6 of Table I. Thi«, ' <| 
procedure, for »>2, is a generalization of 
the technique described in detail by Minsky **1 
in his “Steps Toward Artificial Inteiii- f 
gence.”* Here each entry in the frequency 
memory matrix is replaced by its logarithm, % 


* W. H. Highleyman, “An analog method for 
..character recognition.” IRE Trans, on Electronic 

Computers vol EC-10, pp. 502-512; September, 
1961. (See also Highleyman and Kamentsky.*) 

* Other centering techniques which further increase 
readability were also introduced by Highleyman and 
Kamentsky. 

7 W, Harkness. D. T. Laird, and L. L, Pryor, 
Pennsylvania State University (private communica- 
tion). 

* M.JL. Minsky, “Steps toward artificial inteiH- 
gence," Proc. IRE: vol. 49, PP. 14-15; January, 1961. 
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to niques can be employed ’to^seek the opti- 
hty mum matrix for a given set. The result, 
at §; when found, could then.,fee 'recorded as the 
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Teach the Fundamentals of 
Computer Operation”* 

.... digital computer. T his method is unique in 
that a part of the, audience is divided into 
I; groups jwhere ehcH^ person 'acts'Jas^ a' t>inai^ 

, , the' operation ,of >a “human^elemeht^com- I 
J 1 put^/j-is, 'demonstrated. Un the 'demonstra- j 

similar .‘to an .actual., Computer ’nMwo^5ln f fi 
preli^nindry ■ < »,th student gruup3 

added a. simple computer to extend the 

human-sin.uldtion “games” and to give the 1 

students a transition to the understanding 
°f the physical realization of these basic' - 
• operations. I he simple-computer uses' relays 

represents om jierson. 

During the demonstration we .first pro- 
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PROPOSAL 


OBJECTIVES 

There are presently in use in industry some machines which read 
preset fixed -font type. Also many experimental machines are reading, 
some with reasonable reliability, ordinary printed material. A few mach- 
ines (mainly being simulated on large computers) can read hand-made 
letters of the alphabet with some success. These machines are based on 
a number of different principles applicable to pattern recognition prob- 
lems and while limited success may be claimed for the problem of reading 
by machine, none of these principles seems powerful enough In present 
form to recognize a face as belonging to a certain individual out of a large 
number of individuals. 

It is, therefore, proposed to utilize some of the well known methods 
which have never been applied to facial recognition problems, along with 
certain lately developed techniques and digital computer simulation, to 
attempt the solution of a simplified face recognition problem. In this 
first attempt the work will be restricted to a small number of individuals 
and to single view high quality pictures. In this way it is hoped that a 
better understanding of the overall problem can be gained in the minimum 
time such that the specification of a practical machine might be made. In 
Other words the primary goal of this first phase of the work will be to deter 
mine whether presently available methods can be applied to provide a 
suitable economical solution to the facial recognition problem. 

As a matter of opinion, and based upon such considerations as the 
fact that the unit cost of recognizing a given face among many examples 
of faces could be a great deal more than could be tolerated for the recog- 
nition of a specific letter "A" among all the "A's" in a book for instance; 

It would appear reasonable to expect that some combination of pattern 
recognition techniques could be found such that these goals may be met. 

METHODS 

This research will be based on and, continue from, the pattern recog- 
nition research that has been done in this country during the last few years, 
in particular the n- tuple pattern recognition method first described by 
B fc B in 1959 and since greatly extended. In addition, the investigators 
knowledge and experience in the areas of (1) optimization of complex sys- 
tems (2) simulation on digital computers will contribute significantly to 
this approach. 
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Tills work will require the transduction of many pictures of faces of 
Individuals, several for each individual, into digital computer language. 
The computer, which is simulating a proposed recognition machine, will 
accumulate information from pictures of known individuals and "learn” to 
recognize these individuals. The computer is then fed new pictures which 
It will attempt to identify. 

The way in which the information in the pictures is manipulated by 
machine is, of course, of crucial importance. The methods that might 
be used for this could utilize the concepts of n-tupling, masking, filters, 
thresholds, statistical bookkeeping, correlation (comparing vectors), hill 
climbing, optimization, etc. The investigators have had considerable 
experience in each of these areas and will use parts of all of them as it 
appears profitable. 

During the next several months an attempt will be made to have a 
machine give the names of persons whose pictures are presented clearly 
with a specified view, within a limited number of persons (say 10). Soon 
one would hope to extend the number of persons to thousands, and event- 
ually to recognize from other than the specific pose. 

It is felt that for an eventual recognition machine a certain amount of 
work by humans may be highly profitable. For example, when giving the 
machine a picture to be identified the machine operator might be asked to 
give the sex (if known) , race, etc. and to provide scaling information. 

Also before the machine attempts an identification it would go through 
certain normalization procedures such as scaling, standardizing the total 
amount of light, centering, etc. Also a mathematical technique might be 
worked out whereby each picture is "rotated" to a frontal view before 
recognition is attempted. Another possibility is that the machine opera- 
tor could give the angle of the view and the machine would enter a mode 
especially designed for pictures of that particular angle. 

When the population to be searched become# very large one could 
probably never expect to do better than to divide it up into (hopefully) 
small classes of people who look very much alike. But if these classes 
are very small then humans could be economically employed to make the 
final specific identification. One is, after all, confronted by identical 
twins, so called "doubles" etc. , in the normal course of visual recogni- 
tion and even human beings are sometime e confounded by this problem. 
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ADDITIONAL INFORMATION 

Start with a rectangular picture or Image and assume that It is 
digitised into a grid of black and white squares (Fig. 1). 

MASK, 

By a "mask” we mean an opaque sheet with a window in it (see 
Fig. 1) which can be placed over the picture. One then (usually) counts 
the number of black squares lying in the window (17, using Figs. 1, &). 
This gives a measure of the match between the picture and the mask. 
Certain masks will match A's better than B'e and vice versa. By using 
enough masks and knowing what to look for one can (hopefully) identify 
an unknown picture by how it fits the different masks. Note that If we 
have N masks then, for any picture, we obtain N numbers which repre- 
sent the N measures of match. 

A set of N mask can be used in this way to ’’transform” a picture 
into a set of N numbers (m j , m^, • • • , m^) . This vestor (m^, • • • , m^) 

Is thus a new representation of the picture that may be easier to recognise 
then the original. 

The original picture (Fig. 1) can be thought of as a large binary 
vector. So we transform vectors into vectors by using masks. But in 
either form these vectors must be recognized or identified. 



STATISTICAL BOOKKEEPING 


By statistical bookkeeping on known pictures we can keep track of 
which vectors tended to be A’s and which tended to be B'a and thereby 
hopefully identify a new picture as either an "A" or a "B”. For example, 
the simplieet method would be to average the vectors (either before or 
after masking) for each of the category of pictures (average all the 
B-vectors, etc). In this way we obtain averages X* B, C, etc. Then 
an unknown image can be compared to each of these averages, and 
identified as the one it most resembles. 

CORRELATION 

This comparison is usually done by correlation. If the new unknown 
vector is x * (x 1# x ^ • • • , x^) and 

B * (b 1 v • • • , b^) . 

then the correlation is given by 

X. S m Xj bj 4x £ b, + ... +x N b N 

which is just the ordinary scaler product of two vectors. If x and B 
are a lot alike, then x« B tends to be large. Thus one can use the 
largest of the numbers 

x* X, x* B, etc. 
to identify the unknown x. 

In actual practice averaging of the original binary vectors (Figure 1) 
is not too effective. 
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HULL CLIMBING 

If one changes these average vectors, X, B, Z2, * * • In & clever 
way he will find other vectors, X'. B'. • • • . which are more effective 
for identifying the unknown pictures* x. 

The attempt to find better such X'. S', • • • involves optimisation of 
a function of many variables (hundred, or thousands) and can represent 
a very difficult task. Nevertheless such optimization can produce sur- 
prising increases in the recognition ability of the procedure. 

A harder optimization (or hill-climbing) problem is one of trying 
to pick the best masks. Out of the fantasticly large number of possible 
masks one tries to choose a few which will be most effective for his 
type of problem. The mathematical details of how this can be carried 
out in practice needs more room than I want to take here. But let me 

say it is still mostly an art and one is never guaranteed complete 
success. 

n»TUPLING 

This refers to the concept that Iben Browning and I introduced in 
our 1959 paper on pattern recognition. By this method we attempt not 
only to remember whether a particular square is black or white but 
also its relation to the blackness or whiteness of certain other squares. 

Thus, for example, in Figure 1 we note that the three squares 
marked 1 3 have the states (white, blaek, white). If we put "0" for 

whit* and "1” for black, then this triple has state (0, 1,0) for the 
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particular picture shown. The triple marked i,j,k has state (0,0, 1). 

Of course these two triples would take on different states for other 
pictures. 

In practice one uses not just two triples but many (maybe hundreds). 
Also one could go to higher n -tuples such as 4-tuples, 5 -tuples, 6 -tuples 
In one case we tried 1^ -tuples. These higher n -tuples are difficult to 
handle in the computer because the storage required for each n -tuple 
is of the order of l n . 

During a ’’learning” phase the computer will be given a series of 
known pictures (say a set of ’’A”'*}. The computer will take statistics 
on the states of the various n-tuples and thereby determine which 
states are likely when an ”A” is being read. A similar procedure is 
followed while a set of ”B”'s are being ’’learned”, then ”C M *s, etc. 

Then during the recognition phase an unknown picture, x, is consid- 
ered. The various states of its n-tuples, when compared with the 
statistics that were taken during the learning phase, will (hopefully) 
determine its identity. 

For a given type of picture recognition problem, certain n-tuples 
will be more discriminating than others. It is hoped that a few power- 
ful n-tuples can be discovered which will be effective for the face 
recognition problem. One would probably consider moving a particular 
n -tuple around on the face to see If it ’’fits” somewhere. Other 



complications could be mentioned but the basic idea of an n- tuple, 
like the basic idea of a mask, will undoubtedly be useful. 

THRESHOLDS 

Thresholds are sometimes useful for making a process non-linear. 
For example, after we have counted the number, m, of black square® 
which show through the window of a mask, we then determine whether 
m is greater than a given threshold T. If it is we store a "l" Corres- 
ponding to that mask. In this way a picture is converted, by N masks, 
to a binary N -vector. One would then, adjust T to obtain the best effect. 

A similar use of & threshold can be used in all parts of pattern 
recognition. 

FILTER 

A filter is any device that converts the given picture into another 
picture or into a set of numbers. For example, the original trans- 
ducer which digitises the picture is a filter. Also a set of masks can 
act as a filter in that a set of numbers is produced from the original 
picture. A filter is useful if it converts one representation of a 
picture into another representation which is somehow easier to 
identify. 
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Stoney Stanton Road 
.Police Station 
COVENTRY, CV6 5DG 
England 


W - TLE .. P .A RK ..S TR g.£.T. 

- eO - VCNTR - Y 

' TCti&PMONG No. 0303 555 . 333 . 


r t 

Professor Woodrow W Bledsoe 
MCC 9430 Research Boulevard 
Building 1 
Austin 
TEXAS 78759 


ALL COMMUNICATIONS SHOULD BE ADDRESSED TO "THE CHIEF SUPERINTENDENT" 
YOUR REFERENCE 

¥ 

OUR REFERENCE 
DATE 


19 February 1987 


Dear Professor Bledsoe 

The Chief Constable of this Force has been kind enough to allow 
me to indulge in a part time Ph D study into the ways in which 
we can use computers to recognise the faces of criminals recorded 
by bank cameras, or during riots, etc. etc. 

Presently I am registered as a student with Imperial College in 
London reading under the tutelage of Professor Igor Aleksander, FRS. 
The main thrust of the study is to use Professor Aleksander' s 
'Wisard system* which is a development of the early perceptron 
devices, but in this case using quasi parallel techniques. 

I have had a great deal of difficulty in tracking down copies 
of your earlier work published under the following titles - 

The Model Method in Facial Recognition 

Report No. PRI - 15 Panoramic Research Inc. Palo Alto. 

1964 

Man Machine Facial Recognition 

Report No. PRI - 22 Panoramic Research Inc. Palo Alto. 

1964'. 


I wonder if I could impose on your good nature and ask for a 
copy of these reports? I am well aware that after such a long 
period of time it may be that you have filed them in a library 
somewhere. If that is the case, may I have details of where 
I could obtain them and I will do so. 

Kindly 


M Sc. 
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Figure 2 . Examples of Photograph Pairs Used in the Study 
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THE MODEL METHOD OF FACIAL RECOGNITION 


W. W. BLEDSOE 


Panoramic Research, Inc. , 2670 Hanover Street, Palo Alto, California, 



THE MODEL METHOD IN FACIAL RECOGNITION 


W„ W. BLEDSOE 

ABSTRACT 

This paper discusses the general problem of facial recogni- 
tion by machine, introduces and explains a model method of feature 
location, discusses procedures for feature classification and facial 
recognition, and finally discusses several man-machine techniques 
in facial recognition. 


12 August 1964 




INTRODUCTION 


One of the most challenging areas of pattern recognition is the 
identification of human photographs by machine. In this endeavor the 
machine is expected to disclose the identity of the person whose photo- 
graph it is shown. Since the difficulty of this problem will depend 
• greatly upon the conditions under which it is considered, we will be 
more specific. 

In this paper we will consider only the case where the following 
conditions are satisfied: 

1. There is a large number of people in the population con- 
sidered (perhaps more than one million), 

2. There is exactly one photograph of each person in the file. 

3. Each photograph is oriented in an upright position. 

4. The pose for each photograph in the file must lie between 
the frontal and profile. (See Figure 1) 

5. Other variables, such as tilt angle, lighting direction and 
intensity, and facial expression are not fixed. 

6. For recognition, a photograph (other than the one in the file) 
of a person of the population is presented to the machine and 

it is' expected to 

(a) Identify the person photographed, or 

(b) Make a small list of names which includes the correct 


identity. 



There are many aspects of this problem which make it especially 
difficult. Some of them are: 

1. There is a large number of categories. Whereas the alpha- 
numeric character recognition problem may have only 36 
categories, the facial recognition problem can have millions 
or even billions. 

2. There is a small number of samples available (usually one) 
for each category (person). 

3. The variability is extensive. It includes: 

(1) Head rotation (from frontal, to profile), and tilt. 

(2) Lighting intensity and angle. 

(3) Photograph size (scale). 

(4) Facial expression. 

(5) Aging. 

(6) Hair growth. 

(See Figure 2) 

It is readily apparent that a simple minded approach will not be 
successful for this problem. For example, an ordinary correlation 
technique will fail completely to identify a photograph where the head 
rotation of the new photograph is slightly different from the one of the 
same person, in the file. (See Figure 3). In fact, correlation might 
choose a different person but with the same head rotation, tilt, and 
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Figure 2a 

Variations in Head Tilt 
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Figure Zc 

Variations in Scale and Light Intensity 
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lighting. (See Figure 4) Similarly, failure is predicted for any method 
that does not employ a measuring system which is invariant under the 
changes listed under 3 above. 

THE FEATURE CLASSIFICATION APPROACH. 

It has been proposed^ that the machine should "find" and "classify' 
each of a series of features of the face and use this set of classifications 
to identify the photograph. That shall be our general approach here. 

But how can a machine be made to locate a certain feature such 
as the nose? At first blush this would appear to be a two-dimensional 
searching problem, but it is far more complex than that. For example, 
a simple change of lighting can completely displace the supposed location 
of a feature. Even so, such a search can be carried out successfully if 
coordinated with other necessary activities, such as determining the 
lighting angle, head rotation, etc. 

Our feeling is that the location of the principal features , such as 
eyes, nose, ears, mouth, etc. and the determination of the principal 
parameters of photography , such as head rotation and tilt, lighting 
angle and intensity, scale, etc. , comprise a major part of the problem. 

In fact, we feel that a feature cannot be satisfactorily located until its 
principal lines and parts have been completely located and traced. For 

1. Bledsoe, W 0 W. , et. al„ , "Facial Recognition Project Report, " 
Panoramic Research, Inc. , Publication PR-7, 6 March 1964. 



~ 9 ~ 


if we are to make measurements from the corner of an eye, for example, 
we must know exactly where that corner is. In this sense a feature is 
essentially identified when it is properly located and the photography 
parameters are known and can thereafter be easily classified. 

In order to search for a feature it becomes necessary to know 
its likely location and likely shape. But its location and shape will 
depend greatly on the rotation and lighting angle. On the other hand 
the rotation and lighting angle cannot be properly determined until we 
have successfully, located some features. It would seem then that 
neither task can-be performed first because it needs the result of the 
other. Our approach will be to continually use our best guess of the 
photography parameters in our' search for features and, as we gain more 
information about the features, to continually update and correct our 
photography parameters. 

To carry out such a complicated feedback process, even in a 
digital computer, requires a large and intricate program unless the 
problem can be made more tractible. It is desirable to organize the 
procedure. in such a way that the successive steps in the search are 
similar in nature, so that the whole process is an iteration of almost 
identical parts. 

C OMPUTER AND SCANNER. 

In what follows we shall tacitly assume that a digital computer 
is the machine we have in mind for carrying out the prescribed process, 
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al though no such restriction is necessary. It is assumed that the light 
reflectivity information has been fed to the computer from an optical 
scanner for a sufficiently dense grid of points on the photograph. 

ORIENTATION. 

This writer believes that "orientation" is of prime importance 
in recognition. We first get ourselves familiar with the general surround- 
ings and then proceed to recognize the datail parts. A similar thing 
happens in facial recognition. The observer first recognizes the object 
in the photograph as the head of a person, locates the general position 
of the head and its principal parts and then begins recognition. This pro- 
cess is so fast that it may seem instantaneous and in fact the two steps 
may proceed in very close succession; but, no actual recognition is 
possible without the first orientation step. In fact, there probably takes, 
place a whole series of steps of orientation and partial recognition which 
extend from a vague awareness that "this is a human head, " through the 
determination that "it is a partial profile of a male, " to the recognition 
that "it is John Smith with hat on. " 

HYPOTHESIS GENERATION 

We believe that as these steps in recognition unfold, the brain 
continually generates hypothesis as to what to look for next to accomplish 
further recognition. Feedback is rapid and important; as the previous- hypo 
thesis is verified stronger evidence is thereby provided for a further 
hypothesis and so on until recognition is complete. 
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lt is not our purpose here to argue for a theory of human recogni- 
tion, but rather to set down a reasonable procedure that can be followed 
by recognition machines. Thus in what follows we will outline a procedure 
which causes the machine to continually hypothecate what the object face 
is like and to continually check this hypothesis', and through feedback, up- 
date and regenerate this thpothesis.^ 


THE MODEL APPROACH, 

We believe that this approach can best be implemented by the use 
of a three-dimensional model, which we allow to vary as we proceed 
through the location and identification of features. The projection of this 
model provides a two-dimensional map which acts as a guide in the 
search. (See Figure 5) The photograph, which we are trying to identify, 
is essentially being compared with the map, but not by a point by point 
correlation. The (3 -dimensional) model will start as a "standard 11 head 
with a given set of photography parameters. These parameters and the 
model's shape will gradually change to compensate for discrepancies 
found between the map and the photograph. 

This three-dimensional model can either be a real physical 
model or one which is simulated in the computer. The present state of 
the art of varying physical models precludes the first at this time and 
leaves the simulation as the only practical solution. 


2. This has a similarity to the Problem Solving Programs of Newell, 
Simon and Show. See Reference 3. 
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In order that the necessary changes. in the model be made in the 
most natural and likely -to -succeed way, the features are numbered and 
searched for in a certain predetermined way. Thus, for example, the 
general location of the head is determined several steps before the eye 
locations are attempted. Each feature is searched for in the position 
and shape predicted by the map, and as features are found the model is 
corrected to make the map better "fit" the photograph,, 

The changes in the model will tend to be those which least dis- 
tort the model and, where possible, which can be made by changes in 
its photographic parameters. Thus, for example, if both the left and 
right sides of the head are found displaced a distance, x, to the left of 
the corresponding positions on the map then the model is translated a 
distance, x, to the left; but if the left side is displaced left and the’ 
right side is displaced right then an increase in scale for the model 
may be in order. Similarly, after the head is located, if both eyes 
.are displaced horizontally left this might be corrected by a rotation of 
the head, or if displaced vertically a tilt of the model might be in order. 

LIGHTING , 

Lighting is very important in processing photographs because 
the shadows play a major role in making lines on the face. Thus it is 
of utmost importance that light intensity and (especially) direction be 
determined correctly. 
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Light intensity can be handled fairly well by normalization of the 
total light reflected from the face, but direction is a more formitable 
problem. 

After the general outline of the head has been determined, a first 
approximation of the lighting direction can be obtained by comparing the 
total light reflected from each of the two sides of the face. (See Figure 6) 
This initial estimate serves to help predict the location of shadows from 
the nose, etc. , and the actual location of these shadows, in turn, can be 
used to better estimate the lighting direction. 

AN APPARENT CONTRADICTION. 

Strictly speaking, no three-dimensional information can be deduced 
absolutely from a single two-dimensional photograph. (The object being 
photographed might have itself been a two-dimensional photograph! ) But 
then why can people routinely use such photographs for identification and 
other three dimensional purposes? And why can a one-eyed person func- 
tion quite well without stereoscopic vision? The answer lies, we believe, 
in laws of probability. It is not likely that we are looking at a man whose 
face is completely flat but is colored so that it looks three-dimensional. 

By experience we learn what to expect and what not to expect. We allow 
only certain variations about the norms. Shadows help immensely because 
they give information about the relative heights of objects. A slight, rota- 
tion of the head gives some information on the relative heights oi the parts 


of the nose, given that we know the general shape of the nose. 



Figure 6 


Total reflectivity on the right side 
of the face is about six times that on 
the left side, indicating a light angle 
of about 45° from the right. 
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This then is the basis upon which the model approach can work. 

The model is changed from the most general and most likely to the speci- 
fic in such a way that the changes made are the most probable way to 
attain the desired results. 

FEATURE NUMBERING. 

As mentioned above the features on the map are numbered so 
that they can be searched out in a predetermined order. Certain points 
on the features of the model are designated as key points and play a role 
in locating the features on the photograph. These key points are projected 
onto the map (See Figure 7) and are kept track of during the rotations and 
changes in the model. These key points on the map then serve as start- 
ing points for locating features on the photograph. Thus at all times the 
computer has the location of these key points so that it does not have to 
search for the features on the map as well as the photograph. But once 
the general position of the feature is located it is traced and compared 
with the corresponding feature information, on the map, any discrepancies 
are detected and corrected by changes in the model which are reflected 
as changes in the map. This changing map then becomes, in effect, part 
of the computer program for searching the photograph, because it provides, 
on a changing basis, information on where to search and for what to search. 
In this way the general computer program can be greatly simplified. 
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FEATURE CLASSIFICATlON o 

Once the features of the face have been found, each localized 

area about a feature can be treated as a recognition problem in itself 

3 

and the feature classified in a routine manner . (See Figure 8) Then 
the totality of these classifications can be utilized to identify the whole 
face. 

Another more direct approach might be attempted for the classi- 
fication of features. Instead of locating the feature, as outlined in the 
preceding pages, we might forego their location altogether and rely only 
on the general location of the head, and classify features directly from 
the whole photograph. Thus the machine might be asked to determine 
whether the person in the photograph has a long, medium, or short nose, 
and similar questions, for other features. For this purpose,, as well as 
for classifying the localized features, a straight forward classifica- 
tion procedure 4 could be employed. It is expected, however, that 

unless the feature is isolated the classification of it will be difficult indeed 
and the situation be highly complicated by the uncertainty of the location 
and shape of the feature and the presence of the other features of the face. 
By locating the feature first, the variability is greatly reduced and 
correspondingly the recognition device required is markedly improved 

3. See, for example, Appendix V, page 5, of Reference 1. 

4. See, for example, references 6-9. 








Figure 8 

An eye which has been localized for 


feature classification. 
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with respect to size and speed. 

There is also a more fundamental objection to this procedure. 

It is believed that any partition which will classify noses (say) on all 
types of complete faces, will of necessity at the same time also 
classify the complete faces; thus, if this is the case, there would be 
no point in feature classification. Hence we prefer to localize the 
features first. 

FEATURE MEASUREMENTS. 

In addition to, or instead of, classifications of the features- 

that have been located we can also make measurements of, and 

5 

between, the features. For example, we can measure the distance 
between the eyes (and properly correct this distance to compensate for 
facial rotation), and the distance between the eyes and mouth, and 
the height of the ears, etc. These measurements can be used, with 
or without feature classifications, to help classify the photographs. 

MAN-MACHINE INTERACTION . 

It may become desirable, especially in some earlier stages 
of an application, to lessen the problems imposed on the computer by 
a certain amount of cooperation between man and machine,. The 
following is a list of suggestions along this line: 


5. H. C. McDonald and H. W. Rogers, The Classification of Police 
Photographs, DeVos s and Co. , Los Angeles, Ca'lif." , F94T. 
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A. Input parameters. 

The (human) operator may be called upon to give the machine 
certain parameters at the time the photograph is presented to the 
scanner. 


1 . 

Light intensity 

5„ 

Age 

2. 

Light direction 

6. 

Weight 

3. 

Head rotation 

7. 

Race 

4. 

Head tilt 

8. 

Sex 


Some of these parameters, such as the first five, can be estimated 
by comparing the photograph to a set of standards (See Figure 9). 

B. Location of features. 

By special marks, perhaps using a series of different colors, 
certain features can be located on the photograph by the operators. 

Thus a dot could be placed at - 

1. Tip of 'the nose 

2. Corner of each eye 

3. Corners of the mouth 

4. Extent of the ears 

5. Point of the chin 

6. The middle and ends of the hairline 

7. Etc. 

These positions also could be given by a light pencil on a display (CRT) 
tube, on which the photograph is projected, on request from the computer. 



of poses that can be used by an 
to estimate rotation angle. 
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Then the computer can use these points to calculate distances 
of the type described above under feature measurements. 

C. Feedback. 

In an application where features are located by machine, the 
computer's location of the various features can be verified by the 
human operator through the use of a display tube. The computer 
displays the original photograph on its display table, indicating by 
appropriate marks its location of the features, and also giving the 
photographic parameters it has determined. If these don't satisfy 
the operator he can make appropriate changes. 
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.MEASUREMENTS 


The measurements to be made are the distances between the outside 
corners of the eyes, and the inside corners of the eyes as indicated by D 
and respectively in Figure 8, Thus the problem for the machine is to 
locate the coordinates of these points. Some additional points were located 
in order to find the corners, namely, the top, bottom, left and right sides 
of the' pupil and points along the eyelids as shown in their order of computa- 
tion in Figure 8. The measurements were made by a CDC 1604A Computer 
using photographs that had been scanned, digitized and written on magnetic 
tape. 

ASSUMPTIONS 

The method made two assumptions. The first was knowledge of the 
general location of the horizontal section across the eyes which must include 
vertically about three pupil diameters, one above and one below the pupil. 
The second assumption made was that a rough estimate of the pupil diameter 
was known, 

RESULTS 

Of the seven sections that were scanned Figures 1 to 7, only four were 
measured and the located coordinates are shown in Figure lb to 4b. It 
should be noted that the program was unable to locate the right eyes in 
Figures 3b and 4b. The right side of Figure 4b was rejected by the program 
and in Figure 3b inadvertently not enough data above the eye had been 
scanned. 

The method does not work on the outer corners but the locations of the 
inside corners have been computed in each case that the pupil had been 
located, (cf Figures lb to 4b. ) The inability to locate the outer corners 
is due to the lack of definite black -white transitions caused by the direction 
of incident light, graininess in the photograph, etc. ' In poor lighting the 
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outside corners are not well defined and their precise location by humans 
would be difficult and more difficult for a machine. 

EQUIPMENT- USED ' 

The flow of data handling from source photograph to the final form of 
the data (magnetic tape) is- shown in Figure 9. The output from the TELauto- 
graph scanner had to be modified to be compatible with the A/D converter and 
the necessary circuitry designed and installed by Mr, B. T. Harrell of PRI 
is shown in Figure 10. The scanner has a vertical density of 100 lines/inch 
and the sampling rate of the A/D converter was chosen so that the horizontal 
sampling density was also 100 samples/inch. The effective spot size of the 
scanner with the above modification was about 2-3 sample points. The A/D 
converter output was 6 bits /sample point (i. e. 64 gray -levels) and the final 
data format was about 800, 6 bit characters per scan, line and was written as 
one record/ scan line. 

METHOD OF MEASURING 

The method of measuring by the program was divided into four steps. 

■1. Location of the pupil coordinates. 

. 2. Location at the points along the upper and lowef* eye lids as 
shown in Figure 8. - 

3. Fitting parabolas to the points along the upper and lower por- 
tions of the eye lid. 

4. Computing the inter section' of theupper and lower parabolas. 

Steps 1 and 2 were achieved using the same technique of searching in a 
vertical (horizontal) direction for the maxima of the differences in average 
intensity above and below (left and right) each point in a vertical (horizontal) 
strip. 



3~ 


As an example, suppose that one wished to locate the bottom of the black 
area shown in Figure 11* Then by fixing j one computes for each i the 
difference 

r I A - Tg (White = 0 < 1 < 63 = Black) 

where T. is the average intensity over an area above i and TL is the aver- 
age intensity over an area below i. The boundary at i sk indicated in 
Figure 11 is located by starting to search the values of lb in the area known 
to be white and searching the direction toward the black for the first proper 
maximum (R^.) occurring at i = k, This technique works best when one can 
choose the size of the areas to fix approximately the areas defined by the 
video data 0 

The curve fitting was done by a simple least- square s' polynomial fit 
and in the case the mean-square error was too large, smoothing was attempted 
by the deletion at data points only the no gap filling was done. The deletion 
of points was done by computing the mean \i and standard deviation a of the 
error and deleting those points whose errors were greater than [1 4- a. The 
data points that were found, their fitted curves and the deleted data points 
are shown in Figures 12 to 19. 

SUMMARY • ' 

The methods used have located the inside corners in 6 out of 8 cases 
but failed when trying to locate the outside corners and it is felt that this 
approach would not suffice. The search for the pupil made an unnecessary 
rejection (cf right side of Figure 4b) but this could be remedied. Other 
shortcomings are; long shadows over the eyes and the narrowing of the 
eye lids. The latter could be overcome but making measurements among 
deep shadows will require more sophisticated techniques. As to the accuracy 
of the measurements the reader is asked to compare' the source photographs 
with the accompanying reproductions with the computed coordinates shown. 
(Figure 1 to 4) 
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If accurate measurements are to be made in larger quantities effort 
must be given reducing the computing time, reducing the effective spot 
size of the scanner and perhaps increasing the sampling density to say, 
2.00 samples /inch. In 'making measurements one is not trying to throw 
information away but to use as many data points as possible for each 


measurement. 
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LOCATION OF SOME FACIAL FEATURES BY COMPUTER 


Automatic measurement by a computer of distances on facial photo 
graphs might well proceed in two distinct steps. . v ; . 


s to be measured, 


2. Precise measurements of features by automatic or semi- 
automatic means. ' • 


This report concerns some work that has been done to achieve step 1 and 
the status of present efforts. ./,• '■ 


The general features to be located are the sides and top of the header- 
location of the forehead, eyes, tip of nose, line along mouth, and bottom of 
the chin. These features are located by horizontal and vertical lines as 
indicated in Figure 1 along with their order of computation. /, 


Figure 1 


Features to be located 
and order of. computation. 



Method 

The method used to locate a boundary defined by a black -white (or white - 
black) transition is merely searching for the maxima of the differences in 
average intensity over certain areas. - As an example suppose that o m wished 
to locate the bottom of the black area shown in Figure 2. Then by fixing j 
one computes for each i the difference f;£. 

(here white « 0 < I '< .15 * black) 

where 7 a is the average intensity over an area above 1 and is the average 
intensity over an area below 1. The boundary at i » k indicated in Figure 2 i® 
located by starting to search the values of Rj, in the area known to be white 
and searching in the direction toward the black for the first proper maximum 
(B^) occurring at i » k. This technique works best when one can choose the 
®i»e of the areas to fit approximately the areas defined by the video data. 

This choice of area else is sometimes possible by using ratios of facial dis- 
tances such as the width of eye® to the width of head, etc. 

Data 

The treatment of data has gone through several sixes of photographs ’ 
and sia© reduction by computer so as to be in a convenient form with regard 
to access speed and fidelity. The final form of the present data Is such that 
a 4** x 5” photograph is well represented by 18, 500 -- 48 bit words of storage. 
This form of the data is achieved by the following steps. 

1. The source photograph is scanned by a modified Telautograph scanner 
with the horizontal and vertical sample densities at 100 samples /inch. 

2. An analog -to -digital conversion in which each analog video sample 
is converted to an 8-bit quantity (i. e. 256 level® of gray) and written 
on magnetic tape. 

3. A preliminary pass on a CDC 1604A computer in which each sample 
is reduced to only 4 bits (16 levels /gray) and packed 12 samples/ word 
and written as 500, 33 word records on magnetic tape. 



• ■ ' ' . . • • • . # 

• J 

Rj = I A - I 8 where 
I A = Avera g e intensit y over area A 
I & = Avera g e intensit y over area B 






A sample printout of data from the area around the left eye of the photograph 
in Figure 6 i# shown in Figure ?. Sixteen gray levels are represented by 
White > 0, I, , % 'A. B. C, B # S. F » Black. 

Results to Date 

Several photographs have been scanned for processing by this method 
(See Figures 3*6)-. In particular one photograph has been processed and 
the features (as defined in Figure l) have been located by the computer. These 
results are shown in Figure 6. The horizontal and vertical lines in Figure 
indicate the x and y coordinates obtained by the computer to delineate the 
various-features. 
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FIGURE 6 

FEATURES LOCATED BY MACHINE 
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LOCATION OF SOME FACIAL, FEATURES BY COMPUTER 


C* L, Bisson 

Automatic measurement by a computer of distances on facial photo« - 
graphs might well proceed in two distinct steps. 

1. Finding the general location of the features to be measured. 

2. Precise measurements of features by automatic or semi** 

automatic means. . . .. 

This report concerns some work that has been done to achieve step 1 and 
the status of present efforts. 


The general features to be located are the sides and top of the head, 
location of the forehead, eyes, tip of nose, line along mouth, and bottom of 
the chin. These features are located by horizontal and vertical lines as 
indicated in Figure 1 along with their order of computation. ' 





Figure 1. 

Features to be located 
and order of computation. 
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Method 

The method used to locate a boundary defined by a black-white (or white- 
fclack) transition is merely searching for the maxima of the differences in 
average intensity over certain areas. As ah example suppose that one wished 
to locate the bottom of the black area shown in Figure 2. Then by fixing j 
one computes for each i the difference 

H. f » " Ig (here white a 0 < I < 15 a black} 

where 1^ is the average intensity over an area above i and ~Lg is the average 
intensity over an area below i. The boundary at i a k indicated in Figure 2 is 
located by starting to search the values of in the area known to be white 
and searching in the direction toward the black for the first proper maximum 
(R^.) occurring at i * k, This technique works best when one can choose the 
size of the areas to fit approximately the areas defined by the video data. 

This choice of area size is sometimes possible by using ratios of facial dis- 
tances such as the width of eyes to the width of head, etc. 

Data 

The treatment of data has gone through several sizes of photographs 
and size reduction by. computer so as to be in a convenient form with regard 
to access speed and fidelity. The final form of the present data is such that 
a 4 M x 5 M photograph is well represented by 18, 500 -- 48 bit words of storage. 
This form of the data is achieved by the following steps. 

I. The source photograph is scanned by a modified Telautograph scanner 
with the horizontal and vertical sample densities at 100 samples /inch, 

2* An analog -to -digital conversion in which each analog video sample 
is converted to an 8 -bit quantity (i. e. 256 levels of gray) and written 
on magnetic tape. 

3, A preliminary pass on a CDC 1604A computer in which each sample 
is reduced to only 4 bits (16 levels/gray) and packed 12 samples/word 
and written as 500, 33 word records on magnetic tape. 
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Method 

The method used to locate a boundary defined by a black-white (or white - 
fclack) transition is merely searching for the maxima of the differences in 
average intensity over certain areas. As an example suppose that one wished 
to locate the bottom of the black area shown in Figure 2. Then by fixing j 
one computes for each i the difference . ' • 

R^ w I a - Ig (here white w 0 < I < 15 » black} 

where Ta is the average intensity over an area above i and Tg is the average 
intensity over an area below i. The boundary at i m k indicated in Figure 2 is 
located by starting to search the values of R^ in the area known to be white 
and searching in the direction toward the black for the first proper maximum 
(R^) occurring at i * k, This technique works best when one can choose the 
size of the areas to fit approximately the areas defined by the video data. 

This choice of area size is sometimes possible by using ratios of facial dis- 
tances such as the width of eyes to the width of head, etc. 

Data 

The treatment of data has gone through several sizes of photographs 
and size reduction by computer so as to be in a convenient form with regard 
to access speed and fidelity. The final form of the present data is such that 
a 4 U x 5 U photograph is well represented by 18, 500 48 bit words of storage. 

This form of the data is achieved by the following steps, 

1. The source photograph is scanned by a modified Telautograph scanner 
with the horizontal and vertical sample densities at 100 samples /inch. 

2. An analog-to -digital conversion in which each analog video sample 
is converted to an 8-bit quantity (i. e. 256 levels of gray) and written 
on magnetic tape. 

3. A preliminary pass on a CDC 1604A computer in which each sample 
is reduced to only 4 bits (16 levels/gray) and packed 12 samples/word 
and written as 500, 33 word records on magnetic tape. 



T 


R; = I a ~I b where • 
I A ~ Avera g e intensit y over area A 
I & •- Average intensity)- over area 8 
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A sample printout of data from the area around the left eye of the photograph 
in Figure 6 is shown in Figure 7. Sixteen gray levels are represented by 
White k 0, 1, 9, A, B, C, D, E, F s Black. 

Results to Date 

Several photographs have been scanned for processing by this method 
{See Figures 3-6} . In particular one photograph has been processed and 
the features (as defined in Figure 1} have been located by the computer. These 
results are shown in Figure 6. The horizontal and vertical lines in Figure 6 
indicate the x and y coordinates obtained by the computer to delineate the 
various features, - 











Dj. 


. -j- lA -O LA "CTJ \J CM <V CV CV CM fO CM C-l CM CM C v- CO CM CM fO. CM CO- AI CM CM CM CM CM CM CM fO CM K> IO, fO K> K) n 

: CM JO CM CM CM Mi tO vj JO CM; CM CM CM CVS CM CM CM CM; CM CM’ CM Cm' CM C\J CM CM 1 CM CM CM CV CM CM CM CM' CM CM CM fO fO rO K) fO; rO fO 

CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM r-t CM CM CM CM -r-t CM CM CM CM CM CM CM, CM CM CM CM. CM IO; CM fO, CM CV fO CV CV IO 

CM CM CM CM CM CM CM CM CM (M CM CM CM CM CM CM CM CM. (M W CM CM' CM CM, CM CM CM, CM CM! CM CM, CM CM CM CM; CM CM ; CM CM rO CM K) rO, CM K) 

CM CM CM rH CM CM CM CM CM CM' CM CM CM CM CM CM t-H ■rt -H ■*-«' CM CM CM -rC t-i CM CM CM, CM CM CM CM, CM CM CM CM, CM CM CM CM fO CM fO CO rO K> 

. _ . . . _ . - . - . - : ~ ~ ~ -• C^HCVjriT-^W -ri 'CM ■»H| pM CM: CM CM, CM CM CM CM] CM CM' CM CM- CM CM; CM CV CM CV' CV to, fO fO 

CM' CM CM, W rl r( r* (V (V d CM CM CM CM CM CM CM CM CM CM CMj CM CM CV AJ tO fO. CM CM CM K> 

. , . , . „ „ „ _ CM CM CM rlrj W CVCVCMCMAiCVCVjCMCVAJCVCV OJ CM CV, CV CM CV CV CM CM. CM tO IO K) 

CMCMCMCMCMCMCMCMCMCMCMCMCMCMC\!CMCM;CMCM;CMv- 4'CMCMCMCM, CM Ai' CM CMj CM A^ CM CM CM CV AJ CM, CM CMCMtOCMCMCM'CVCV 


\ mi vvi n vv n wvj vv v v» iv wxj v m vv «. m vv 

T-f CM CM CM A4 AJ A-i CM C\| CM CM. CM CMj CM C\1 CV 

tH CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM w. -r-., x-, vm ^ k., 

CVCVAJCVCMAJCMCMCV CM- C\| CM CM CM CM CM CM <\J CV H H CO CV W CM CM Cvi CM CM- CM CM- CM CM CM 

CM CM CM CM CM CM CM CM CM CM CM CM CM' CM CM CM CM; CM CM CM W CM CM CM CM, CM CM CM CM, CM CM, CM CM CM CM CM CM, tM CM CM C.M ^ CM CM CM CM (M 

CM CM CM CM CM CM CM CM CM CM CM| CM CM* CM C\f CM CM CM CM CM r-Ci CM CM; CM CM; CM CM CM CM; CM CM CM CM' CM CM, CM , CM, CM CM CM CM CV AJ fO fO, CM CM 

CMCMCMCMCMCMCMCMCMCMCMCMCM’CMCMCMCMvCMCMCMCm'cMCMCMCMCMCMCMCM‘CMCMCMCMCMCMCMCM;CM(M. CV rO.tO CV JO tO. AJ CV 
rMCMCMCMCMCMCMCMCMCMCM;CMCMCMC\iCMCMCMCMCMCMCMCMCMCMCMCMCMCM!CM CM; CM CM’ CM CM CM CM CO CV fO fO, fO fO. V O O CV 
«H >HCMCMCMCMCMCMCMCMCMCMCMCM CM CM CM CM CM C\i CM CM CM CM CM CM fO CM CM, CM CM fO CV CM AJ CV fO fO fO 1 fO T' ; V LA' V V, fO tO 
CMCVCMCMCMCMCMrHCMCVCMCMCMCMCMCMCMCM(pM(MCMCMCMCMCMfOM-;rOCM, K) CM! CMfOKJCVrOfO; IA lA; 

CM'CMCMCMCMCMCMCMCMCMCMCM.CMCMCMCMCM;CMrOCMfOK>CM'?TrOM-lAmirii’M'rOin'T:M-r>lAM-,lALAVsO'£llAvOlA;vrO 
rvi rvi rvi rvt rvi r\i ai ai rvi ai ai ai ai At rvi m oi rvi ko n-v *r' *cr -cf-- vrt ir\ irv nrv Av vr <ri M3 m3 M3 ia cn PnI a* aU vO co An A* An M3 LA v; 

la' 


w (M (\j w w i\i lv l\i l\i w w t\i w w w n !\j rv n w v n t u\ ut ui v n ut v: v rj ut ^ ,ut ui v -nj 
CVJC\JCM<\iCMC\IW(NJWCM(\JC\JCMCMCMCV. CMWfOKlv;’T'r''OLfUAa>N«c;'CMvO'0'OLftCOr^^A;'OCOi't^A'j.' 

CVAJCVCVCVCVCVCVCVCVCVCVCVCVCVCVCVCVM-;rOUNM3M30'CX>COO'COCO C0'OC0(»'c0c0<O0'0'0'<C0c0CM0N 

r\i Ai Ai A! A I A I Ai fA m » ia i a a t rv-. <v-V m nr - : n> r\‘ at.' a «-rii A A 1 A. A m-f <j! <f *£. <X CCl , <f CK CO O' . A- M3 


LV L\J IV t\i IV IV LV l\l LSI WLXUVI LSU\) IV IV l\J tj; n U\ >U sy US UJ ttt U' W W, W SU W W u; W ■y. 

•H CV CM CM CM CM CM CM CM- CM CM CM CM CM CM IO tO 'C IA. LA An ( 00 CCS CD CD O O' <t OC J O' C 0 .j O' C\ O O' <C 

{MCMCMCMCMCMCMCMCMCMCMCMCMCM^IOUS\ 0 v 0 \ 0 < CQ<c:OOOUJQOCnC 0 <<< 0 ' 0 '<;O<C'<C<, m CD CD b O N 
CMCMCMCMIMCM. CMfOCMCMCMCMfO;rOLA'Gr^COC>;c>QLiiaUJUJUJU. ! ljuLlJOC[jO< 0 'OOCCCO i COO',<CO<<'CDCDCOO' 

SA A t KA fcA »A I A |V\ /A AA f s » I t t . t I *' » . • ! L . I . I « . « » i‘ /— v r *% ! /*A — ✓ A. ATV Aw i fv rr\ N. . ■t* rv m ^ 

<r 

uj U- U.L □ <! O' O'! sO h- rs N IA SCI -O -ON M 3 An M> M 3 N* CO O' 
■< 0 '!cor>vo<)A*r v 'iAuSM-'<riA , M'LA'OiA'Orvco 

ii-L.lL-tiJii.Li.;iuqo< : CDolcO'fiKMr'j-sor / )' 3 -|'rwici'Timn'ONN 
Ll Ix' u li .1 U < < Cl CO O'! IA v| to fO n fO PO fO. n IO V V M' V. V IA M 3 s£> 
U.U_!u_U.'<to!< Osr^'OVtOCMCMCMtOCMrOVrOrOtOtO’M-rOlAIALA 
U. U.! OJ C O O ' 1 O CO VO IA to W CMCMCMCMfOCMCMrOCMrOCMtOtOtOM-'O 
Ll III O < < <C l (XJM°lAV’CMCMf'OK) PO CM tOCMCMCMtOCMCMCMCMCMtOT 
U.COO'O'O'CO'CCMCMtOCMCMPOPOrO'M-rOCMCMCMCMCMCMCMCMCMCMtO 

. . . n*'n k ^ 1 I /->! AIAIAI AI KA rK KA >ri- KA M-s KA A I KA KA AI At AI AI AI Ai 


WWWWC\JWniVWWWrQHin'e^ro(P(>QLUDUJUJUJLL'LLLUUtI;U«Ct7'(WWLU | WU'.<LiU«L<l'llJU>UJ 
CMCMCMCMCMCMPOCMPOtOPO IA M" <X>; CO O'! QD O. Q UJ U_ LLl' U- L»- UJ Lx_ tiJ’ Q O; CO <£ O' CO CO 1^*] CO CO CO <C. O <C (X3 
CM CM CM CM CM to to M-, IA LTt 'O CC ; 1^* O' O' CO 1 Q LUj UU U.J Ll. Luj UJ LJ U. U. 1 b_ 0 ! O CD, O' O' cc cO'or^;r^r>r-.r^ 1 h>co-rvcc o 
CMCMCMCMCMCMtotn'^'Or>Kco^c>!XiaiQ l LLii^|u_Lu | u-u.!u_uJu_UKL : Q<c!cA^i'Or^r^r^iA'Oi'0'Or>.'C>r>Ksoor^'CO 

cm cm . cMCMCocMtO'CLn'Ococ>praaouJLiuU|L 4 .L^u.u.;u.LJu.a»<tO'!cor^vO'Or^r^iAuSM-'<rin , M-Lrt'Oir\'Orv 


u. u. 


•cm~cm (MCvwro'j-m'OMj'oqoDiuu. 

CM CMCMCMCMM" >6 O O < O Q US Ui U. 

WCVW!MttsO'OONO<CQLUQaiUJU 
CMCMC\JCMCMvOCQOsCOa:OOUJUJLULi,U. 

CM(Mc\iroror-os<co'OUJLULiJUJU-u.u 

CMCMCMM-rO-OCQ. u Cl C U3 U. UJ lx, UJ U. U-! U. lx 

^ A. A. _ ^ ^ , , |, .... , . 

CM 
CM 
NT. 
ro 
to 



K lO Oi CO Q’ Q ul Ll 
COO<OQDU iLLiJ 

" ccT< a o o lu ui u. ul 

Ci[T‘UDDU.WU.U; 

a> caaujuju.uiu.ui 


CPi 

O'! 

% 

o 

OS 

CS 


Ul Lu II! U. 
ui U. Ui u. 

<CDUJUU.UjU.UilL 


ui u. 

LJ tu 

ui u u u u lu O'! co <m qujiuq6n©o<;< 

Uj U U 1 U U UJ <-m U, LU LU Q < CO D'. < O < 

u| U. u| U UJ D <; CO.^ <UUJUJQ<COIIl CDQ'O <j N >0 
U,Uu]UJUJUCvc0N<rDOliJUJDC'DUO;U0' 1 '0in 

u! u u|u acDOiO'N" ^ a„,aa a.k.k 

uj u. Uj 1 uj a 


<Q LLIUIL 
< UUIUU 


uuJqq 


O O 1 'O V, ro ro (V CV CM CV to to 
O' PM IfN’Sr'CMrOCMCMCMCMCMLO 
CON lf\tTrOK>rOCMCMCMCMCM 
vOinVfOCMrOCMCMCMCMCM 
rr LA to CV ro CM CM CM to CM 
rvcOOLUOUjaaCCO<C> ) ’sOOlALAvrOCMCMCVrOCMCM 
<<>0'coimnoo<ULUDCDCD<coN'O^M'M-iocMrcitororo(NJ 
CO<C<COtALA'0 0>CO<£QOOQCDOvcOvOlAVrOrOCMCMCMrOrOC\J 



<c ca 
0 ai 
< CD 


CNO'CSO'OsO'CrjOOCOCEOCDOOcd 
tqa'0)0 'CM>oa'<<<<< 0 'co 
CO O' Ot O' O' O' O'-O' Oj O' O' O' < O' co 
0'0'CQC0CM>O0'a0'0i0'<<O; 
OS C00'c00'0>0'0'0'0'0' l 0'<<cd 
0 ' 0 ' 00 'c 00 c 0 c 00 ' 0 ' 0 ' 0 '< 0 'c 0 


O' O' O' O’ O' 
< O. O O' O' 


O} 0'00'-< O' Oj O' CO O'O' COCO CO O' 

a <<< 0 j 0 ' 0 | 0 ' 0 ': 0 ' 0 ' , c 00 i 0 ' 0 '' 
CO < C On‘< Oj <f Oj on Os o OS O' Os 

moco<<<<!<< 0 '<;o'<,<o; 


*< <c 
<c 
CO <c 
m < 

CDOdUCDCD<CQ<<<<<<< 
O OUCCUCDCD< l <li<<<<< 
modO'CD<< 0 '< 0 ' 0 ' , 0 'coco 
ONO'Oir^-<cco-r^O)AK,cor^vO'0 
rMr^HNor^rs.vO'OrS'O'OvOM-LA 


i. - ur\ -in la un ia ia vp in sr, inuSiniri 


x-JCMK)VlAOf<COO'CD T HCMtOM*LA | 
rorotorororororotovv, M-VM-v 


HrtrlrtrlH 




a 

O 

<C 

ocj 


K 

NO 

LA 

A. 

co 

< 

CD 

O' 

<c! 

o 

<1 

O' 

CO 

M 3 

UN 

V 

ro 

CV 

to 

CV 

CV 

ro 

CV 

CV 

ro 

ro 

K 

UJ 

O 

c 

O', 

CO 

NO’ 

A> 

N 

CO 

O'! 

CD 

CD 

CO 

o^! 

CQ 


< 

CO 

An 

UN 

V 


ro 

ro, 

ro 

ro 

to 

ro 

ro 

ro 

ro 

K 

UJ 

o 

CD 

< 

CO 

MO 

Pn 

AM 

CCt 

o>! 

<t 

<r. 

co 

O’! 



O' , 

CO 

CC 

M 3 ' 

V 


V 

ro 

ro 

ro 

to 

to 

ro 

A 3 

to 

A 

a 

a 

CD 

CD 

O' 

NT- 

MD 

An' 

An 

CQ 

O' 

O', 

CO 

On 

•< 

<C| 

CO 

co 

CO 

As 

M 3 

UN 1 

UN 

to 

ro 

V 

to 

ro 

CV 

ro 

ro 

A 

a 

a 

U 

a 

O' 

LA 

V 

O 

co 

A- 

O' 

co 

CO 

AS 

O' 

O' 

A- 


Av 

An. 

LA 

V 

V 

u> 

ro 

V 

ro 

ro 

ro 

CV 

CV 

0 

a 

a 

o 

o 

O' 

vO 

LA 

MD 

O' 

CO 

co 

S 

A» 


CO 

CO 

NO 

o 

An 

M 3 

UN 

UN 

UN 

M 3 

V 

ro 

ro 

ro 

ro 

ro 

ro 

O 

a 

a 

c_> 

CD. 

< 

co' 

An 

CO 

<C 

O' 

CO 

N 

00 

d 

CO 

N 

UN 

o 

M 3 

M 3 I 

V 

v: 

V 

V, 

V 

LA 

V 

V 

UN 

M 3 

LA 

V 

a 

u 

a 

CD 

DO 

CO 

nO 

o> 

CD 

O' 

CO 

ca 

O' 

o; 

O' 

r< 

UN 

M 3 

M 3 

LA 

V 

ro 

to 

vi 

V 

UN 

V 

V 

'LA 

CO 

An 

u 

o 

o 

a 

O 

CO. 

O', 

O' 

CO 

< 

o-. 

CC' 

CO' 

O' 


CO 

A' 

mD 

UN 

LA 

LA 

V 

lA 

V 

uN 

UN 

M 3 

UN 

V. 

US 

An! 

An 

M 

CO 

CO 

cc 

CD 

CO 

O', 

CO 

O' 

<< 

< 

o 

ON 

O' 

O' 

O' 

A- 

MO 

UN 

UN 

LA 

UN 

UN 

UN 

M 3 

M 3 

UN 

UN 

LA 

M 3 

M 3 

An 

A 

O' 

<c 

CD 

<r 

< 

<t! 

O' 

O'. 

<C 

-<T. 

< 

CO 

O' 

O' 

O' 

CC 

An 

M 3 

LA 

M 3 

LA 

M 3 

M 3 

M 3 

M 3 

M 3 

An 

A- 

As 

Ai 

CO 

« 

CO 

o 

•< 

O' 

O' 

On 

On 

On 

O' 

ON 

O' 

CO 

O' 

O' 

O' 


CO 

AS 

M 3 

M 3 

r^. 

M> 

An 

rS 

A- 

An 

An 

An 

A. 

Ai 

CO 

CC 

A- 

O' 

•< 

O' 

co 

co’ 

On 

CN 

O' 

< 

O' 

co 

O' 

<t. 

< 

CD 

O' 

co 

CO 

AU 

CO 

rS 

A 

A< 

CO 

CO 

CO 

AS 

An 

Ai 

03 

O 

N 

CO 

O' 

O' 

A* 

CO 

O' 

O' 

O' 

<r 

O' 

O' 

■C 

c 

O' 

<r 

O' 

Os 

O' 

os 

CO 

CO 

CO 

co 

CO 

O' 

O' 

CO 

CO 

CO 

CA 

o 

r^. 

rs 

O' 

CO 

A' 

O', 

O' 

O' 

<£ 

O’ 

O' 

O' 

O' 

O'! 

O' 

O'! 

CO 

oi 

O' 

O' 

O' 

o 

O' 

Os 

O' 

O', 

O' 

O', 

< 

O 

< 

<J 

O' 

r- 

co 

CO 

CO 

On. 

< 

o> 

■< 

On 

O' 

O', 

O' 

ca; 

O' 

O' 

O' 

<i 

O' 

O' 

<1 

<c 

<c 

O 

O' 

O' 

O' 

O' 

< 

<t 

< 

CC 

CO 

vO 


co 

co 

CO 

O 

<Z 

O' 

O' 

O' 

O' 

O' 

O'! 

O' 

O': 

O' 

O'! 

o 

O', 

O' 

< 

< 

O'! 

O'. 

<t 

< 

< 

CD 

CD 

CD 

cc 

CO 

MO 

MO 

CO 

CO 

CO 

CO 

o- 

O' 

co 

O' 

co' 

CO 

CO 

O' 

O' 

O' 

Ov 

O' 

O' 

< 

<c 

<c 

<c 

<C 

< 

CD 

CD 

O 

U 

o 

a 

CO 

vO 

O 

co 

O' 

a* 

co 

co 

O' 

O'. 

o 

Os’ 

O' 

CO 

O' 

O': 

O' 

0 ( 

O' 

-Mi 

<c 

CD 

<£ 

-ai 

<J 

a.- 

a’ 

CD 

O 

o 

o 

t_ 

CO 

'O 

*o 

r-K 

O' 

co 

CO 

CO 

O' 

O' 

O' 

o! 

O' 

O' 

<t 

< 

O' 


O' 

<Ci 

<t 

/“TN 

• J. * 

CD 

rr, 

CD 

o 

r Y'. 

o 

o 

C 3 

Q 


CO 

CO 

Ak 

LA 

CO 

co, 

O' 

O' 

o 

ON 

O' 

os 

<c 

■< 

CO 

<c. 

< 

<£ 

CO 

CD 

CD 

CD 

CD 

CD' 

O 

o 

CD 

o 

L 3 

o 

o 

c 

CO 

o 

CO 

LA 

A* 

CO 

O' 

ON 

o 

O', 

O' 

<d 

<c 

<c 

CO 


<t 


CD 

03 

CD 

03 

CD 

o 

o 

a 

O 

o 

CJ> 

o 

o 

LI 

O' 

O', 

On 

o. 

r-K 

o'-; 

< 

On 

o 

O', 

ON 

<! 

<£ 


< 

<1 

< 

<1 

CD 

< 

CD 

O. 

CJ 

L> 

o 

o 

L) 

o 

o 

o' 

o 

c_ 

O' 

on 

ON 

nO 

PN 

O' 

O' 

<c 

ON 

O'! 

-=c 

CD 

<c 

CD; 

< 

<r; 

CO 

< 

o 

CD 

O 

O 

O 

O 

o 

o 

O 

o 

o 

o 

o 

c 

c 

os 

O' 

rJ 

An 

OS 

CD 

< 

c 

CD 

<c 

CD 

< 

<1 

< 

CD 

CD 

CA 

L 3 

CD 

u 

o 

u 

u 

o 

CD 

O 

o 

a 

p 

u 

c 

O' 

co 

CO 

MO 

mo 

°1 

<£. 

O' 

O' 

O 

< 

O'; 

O' 

<C: 

o 

CC- CD 

CD 

-a: 

CQ 

o 

CD 

o 

CD' 

CQ 

CO 

a 

o 

o 

o 

u 

u 

O' 

co 

co 

UN 

An 

H 

O' 

ON 

cc 

cq 

co 

vO 

co 


o 

o! o 

Cd 

< 

CD 

CD 

o 

cr. 

CQ 

03 

CD 

o 

o 

o 

aq 

L> 

u 

o 

vO 

A~ 

NTS 

NT 


As 

AnI 

LA 

vO 

UN 

us 

MO 

co. 

o 

o 

1 ° 

at 

CD 

CD 

CD 

CO 

CD 


CD 

CD 

o 

D 

o 

o 

o 

u 

UN 

MO 

mO 

Ki 

ro 

NT. 

UN 

vb 

LA 

LA 

UN 

LA 

NO 

CCS 

CC 

o 

o 

o 

CC 

CD 

CD 

■ <c 

CD 

CD 

O 

O 

c 

UJ 

LU 

a 

CD 

c 

LA 

LA 

in 

Mi 

V 

US 

UN 

vO 

UN 

V 

LA 

o 

MO 

CO 

o 

o 

CD 

cpi 

CD 

CD 

CD 

CO 

O 

Q 

Q 

UJ 

u. 

U- 

UJ 

UJ 

a 

t_ 

LA 

LA 

V 


V 

LA 

UN 

LA 

UN 

LA 

LA 

'A 

A» 

ao 

o 

o 

O 


CD 

CD 

O 

o 

UJ 

UJ 

U, 

u. 

UJ 

UJ 

LU 

u 

,- a 

a 

o 

ITS 

NT 

K> 

'T 

v; 

UN 

LA 

LA 

UN 

UN 


.Tk. 

t>: 

jo 

o 

a 

o: 

no 

CQ 

a 

LU 

u_ 

UJ 

U. 


LU 

UJ 

u_ 

UJ, 

UJ 

't 

in 

LA 

V 

CM 

to 

rr 

UN 

V, 

V 

LA 

UN 

NO, 

NO 

O' 

o 

o 

o 

CO 

co 

o 

UJ 

LU 

UJ 

Ui 

u. 

UJ 

UJ 

UJ 

UJ 

LU 

UJ 

c 

LA 

LTV 

V 

CM 

ro 

VI UN 

UN 

UN 

LA 

UN 

UN 

Ak 

CD 

:a 

a 

CD 

o! 

UJ 

UJ 

u. 

LU 

UJ 

UJ, 

UJ 

u. 

u. 

u. 

UJ 

Q 

UJ 

c 

UN 


i " 1T 

to' 

V 


UN 


UN 


UN 

LA 

CO 

o 

I L 0 > 

a 


°j 

UJ 

U-: 

u. 

u_ 

! uj 

UJ 

u. 

U-‘ 

u. 

UJ 

UJ 

a 

UJ 

! 

u 

'O 

r< 

1 co 

o>! 

o 

H 

CV 

to 

V 

LA 

* 

nO 

A- 

! co 

o 

! o 

'rt CV 

wj 

M- 

LA 

'm 3 

An 

'co 

on 

o 

•H 1 

AJ 

to 

V 

UN 


A 

V 

V 

; v 


UN 

UN LA 

UN 

UN 

LA 

UN 

UN 

UN 

LA MO 

NO 

: o 

'A 

M 3 

M> 

M 3 

M 3 

M 3 

'A 

An 

OS 

An 

An 

An 

Ai 

I An 

A 



; vi 

•H 

r-i 

"1 




T~i 


Y -1 

1 W 

tH 





T-i 

Ti 


pH 



pH 


pH 


r* 

H 


vr 


«> 1 1 ■ 





5 EM I /U4/2. i ALK Ccjt) 1 * , ifsrz 

0 'He $ <A-frAr MoCt£** 
















1 amJ& A) 



,i. . 2 : ^^ 0 . jr #. H ^.„ 


iMxfck*. __ £ m /__ dii^Lo 


\ / *, . b&MudL 

2 . .. 4 £ ^ 4 ^ Al^t^ 





"XP~C%Ja-> / 1 ju&Jtihu t^_ ~*fy^t'Cunrt^£~ 

** 2 - , ’~yi&'%AA''~t&*£~: d**4? *2 



>L* uwJZ- 




